- Title
- Detecting changes in facial temperature induced by a sudden auditory stimulus based on deep learning-assisted face tracking
- Creator
- Sonkusare, Saurabh; Ahmedt-Aristizabal, David; Aburn, Matthew J.; Nguyen, Vinh Thai; Pang, Tianji; Frydman, Sascha; Denman, Simon; Fookes, Clinton; Breakspear, Michael; Guo, Christine C.
- Relation
- Scientific Reports Vol. 9, Issue 1, no. 4729
- Publisher Link
- http://dx.doi.org/10.1038/s41598-019-41172-7
- Publisher
- Nature Publishing Group
- Resource Type
- journal article
- Date
- 2019
- Description
- Thermal Imaging (Infrared-Imaging-IRI) is a promising new technique for psychophysiological research and application. Unlike traditional physiological measures (like skin conductance and heart rate), it is uniquely contact-free, substantially enhancing its ecological validity. Investigating facial regions and subsequent reliable signal extraction from IRI data is challenging due to head motion artefacts. Exploiting its potential thus depends on advances in analytical methods. Here, we developed a novel semi-automated thermal signal extraction method employing deep learning algorithms for facial landmark identification. We applied this method to physiological responses elicited by a sudden auditory stimulus, to determine if facial temperature changes induced by a stimulus of a loud sound can be detected. We compared thermal responses with psycho-physiological sensor-based tools of galvanic skin response (GSR) and electrocardiography (ECG). We found that the temperatures of selected facial regions, particularly the nose tip, significantly decreased after the auditory stimulus. Additionally, this response was quite rapid at around 4-5 seconds, starting less than 2 seconds following the GSR changes. These results demonstrate that our methodology offers a sensitive and robust tool to capture facial physiological changes with minimal manual intervention and manual pre-processing of signals. Newer methodological developments for reliable temperature extraction promise to boost IRI use as an ecologically-valid technique in social and affective neuroscience.
- Subject
- thermal imaging; facial landmark identification; galvanic skin response (GSR); electrocardiography (ECG)
- Identifier
- http://hdl.handle.net/1959.13/1454928
- Identifier
- uon:45023
- Identifier
- ISSN:2045-2322
- Rights
- © Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
- Language
- eng
- Full Text
- Reviewed
- Hits: 2779
- Visitors: 2899
- Downloads: 128
| Thumbnail | File | Description | Size | Format | |||
|---|---|---|---|---|---|---|---|
| View Details Download | ATTACHMENT02 | Publisher version (open access) | 2 MB | Adobe Acrobat PDF | View Details Download |